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Abstract 

I present a generalization of the Ehrenfest urn model that is 
aimed at simulating the approach to equilibrium in a dilute gas. The 
present model differs from the original one in two respects: 1) the two 
boxes have different volumes and are divided into identical cells with 
either multiple or single occupancy; 2) particles, which carry also a 
velocity vector, are subjected to random, but elastic, collisions, both 
mutual and against the container walls. I show, both analytically 
and numerically, that the number and energy of particles in a given 
urn evolve eventually to an equilibrium probability density W which, 
depending on cell occupancy, is binomial or hyper geometric in the 
particle number and beta-like in the energy. Moreover, the Boltzmann 
entropy InW takes precisely the same form as the thermodynamic 
entropy of an ideal gas. This exercise can be useful for pedagogical 
purposes in that it provides, although in an extremely simplified case, 
a probabilistic justification for the maximum-entropy principle. 

PACS numbers: 02.50.Ga, 02.50.Ng, 05.20.Dd 
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1 Introduction 



The modern intuition of the emergence of the Second Law of thermody- 
namics from mechanics is mainly grounded upon the behaviour of stochastic 
urn models, where "particles" are subjected to a probabilistic dynamics that 
eventually generates a sort of thermodynamic equilibrium [1] . Obviously, this 
stochastic (Markovian) dynamics is only a caricature of the "real" (Newto- 
nian) dynamics; it is much like an effective dynamics which emerges after 
averaging over many instances of the complicated short-time motion. 

In the classical Ehrenfest model, N numbered balls are distributed into 
two urns; at each step of the process, a ball is extracted at random and 
moved from the urn where it resides to the other. Eventually, the number 
of balls in each urn fluctuates around N/2, with relative deviations from the 
mean becoming negligible in the large-iV limit. This stochastic process is 
taken to represent the attainment of particle-number equilibrium in a dilute 
gas diffusing between two communicating vessels of equal volume. 

In order to improve the Ehrenfest model so as to make it more realistic, I 
consider a generalization where the balls/particles are endowed with both a 
discrete position and a continuous velocity. To be more specific, we are given 
two boxes, 1 and 2, and N particles in the boxes. Box 1 (2) is divided into V\ 
(V2) identical cells, with V — V1+V2 the total cell number. The occupancy c a 
of the a-th cell can be either multiple (c Q = 0, 1, 2, . . .) or single (c a = 0, 1), 
with both possibilities being considered. The velocity of the a-th particle is 
v a , a three-dimensional vector with components v a k (k = 1,2,3). 

To make things simple, positions and velocities are updated indepen- 
dently and by turns, in such a way that the two dynamics of free motion 
and collisions will proceed in parallel though staying separate. Hence, the 
stationary state of each set of variables can be analysed on its own. Along 
this route, one arrives at a probabilistic foundation of the expression of the 
ideal-gas entropy in thermodynamics and, concurrently, at a justification (in 
this case only) of the maximum-entropy principle. 

2 Position updates 

Let us first suppose that each cell can host whatever number of particles. 
A position update consists of i) choosing at random one particle, a r , and 
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one cell, a r ; and ii) moving a r from its original cell into a r . In terms of the 
variable n, which counts how many particles are hosted in box 1, this defines 
a stochastic process of the Markov type, with transition probabilities: 

r(B+ l^„)=(^ i T ( n-^n)^. (!) 
The ensuing master equation admits the binomial distribution 



as unique stationary distribution [2]. Since the Markov chain is ergodic (i.e., 
there is a path connecting every (macro)state n to every other n'), any initial 
distribution P(n; 0) will converge, in the long run, to W(n). In particular, 
the average n goes eventually into NV\/V , with relative deviations from the 
mean of 0(N' 1 / 2 ) [2]. The multiplicity of macrostate n, i.e., the number of 
complexions (microstates) of N numbered particles in the boxes, such that 
box 1 contains n particles, is just W(n) x V N . Assuming n, N — n = O(N) ^> 
1, the equilibrium entropy S(n), defined as the logarithm of the multiplicity, 
is additive over the boxes and extensive with N: 

S(n)~-n\n^-(N-n)\n?^L, (3) 

being maximum for n = NVi/V. In Eq(3), we recognize the volume contri- 
bution to the ideal-gas entropy. 

While all of the above is rather standard, a novel result is obtained when 
each cell in the boxes can contain at most one particle. Now, at each step 
in the process, the selected particle a r is moved into a cell a r that is chosen 
at random among the vacant sites. The transition probabilities read (with 
V 1 ,V 2 >N): 

1 + U) N(V-N) ' 1 U) N(V-N) ' 1 ] 

yielding a hypergeometric stationary distribution for n [2] : 
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As in the previous case, the average n converges eventually to NVi/V, with 
relative deviations of 0(N^ 1 ^ 2 ). The multiplicity of state n, i.e., the number 
of ways N indistinguishable particles can be arranged in the boxes, in such a 
way that n particles are placed in box 1, is equal to W(n) x QQ. Assuming 
n, N — n, V\— n, V 2 — (N — n) = 0(N) 3> 1, the equilibrium entropy becomes: 

S{n) ~ — nln— — (Vi — n) In ( 1 — — ) 

N — n / N — n\ 

(N-n)ln-^-(V 2 -N + n)\n(l-^—j , (6) 

being maximum for n = NVi/V. Equation (6) is nothing but the thermody- 
namic entropy of two ideal lattice gases that can mutually exchange energy 
and particles. 

3 Velocity updates 

The collision dynamics of equal-mass particles can be roughly schematized 
as a succession of random binary events which, however, are still required to 
obey energy and momentum conservation [3]. On the macroscopic side, such 
collision rules go along with the conservation of total kinetic energy and total 
momentum, thus being appropriate only to a very dilute (gaseous) system 
of particles. If, moreover, we are willing to drop the momentum constraint, 
provision should be made also for elastic collisions against the walls of the 
(cubic) container. 

As far as the mutual collisions are concerned, I assume their outcome to 
be as maximally random as possible. This amounts to update the velocities 
of the colliding particles as: 

v a ^ v' a = v a + £r; v b ^ v' b = v b -£r, (7) 

where £ = (vi, — v a ) • r, and f is picked up at random out of the emisphere of 
unit-length vectors forming an acute angle with v b — v a . If mutual collisions 
occur at a rate of p, the master equation for the velocities finally reads: 

tt({t/}; * + !) = / d 3N v t({v'} <- {v}) 7r(M; t) , (8) 
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with r 

T2(W}^{V}) = 



1 — p)t\ + pr 2 and 

N 3 



a=l k=l 

2 



£(u^ + Uak) II 5 ( V 'bl- V bl) 
(b,l)y£(a,k) 



N(N-l) 



a<b L 



271 \v a - v b 



■5 3 (v'a + <-Va-V b )5(v' a 2 +V> b 2 



c^a, b 

The following properties can be proved [2]: 

• A stationary solution to Eq. (8) is w({v}) = F{y\ + . . . + v%), for any 
properly normalized function F. 

• Upon denoting the one- and two-body velocity distributions at time t 
as fi(vi,t) and ,/ 2 (t>i, t> 2 ; £), the following exact equation of evolution holds: 



/ifof + l) = (l-p){(l-^)h(vi;t) 



For any function $, the ansatz f^{v\, V2) = + f|) gives a stationary 
solution to Eq. (10). However, in case of an isolated system with total en- 
ergy U, the only admissible solution to Eq. (8) is the microcanonical density 
w({v}) oc 8{v\ + . . . + v% — U) [4], and the $ function becomes: 



3(JV-2) 1 



T(3(iV-2)/2) 



(11) 



leading in turn to: 



/i (cq Vi) = 



T(3iV/2) 



r(3(iV- l)/2) 



[irU)-i 1 



u 



(12) 



The latter is the finite- N Maxwell-Boltzmann (MB) distribution [5]. In the 
N, U — > oo limit (with U/N = 0(1)), one recovers from Eq. (12) the more 
familiar Gaussian form, fi Cq \v) = (k/tt) 3 / 2 exp(— kv 2 ), with k = 3N/(2U) 
(corresponding to an average v\ of U/N for all a). 

• I have carried out a computer simulation of the evolution encoded in 
Eq. (8) in order to check whether the stationary distribution (12) is also an 
asymptotic solution, as expected (at least when p > 0) from the ergodicity 
of kernel (9). First, I set N = 3 and U = 0.06, with p = 0.5. Starting 
at any particular microstate with energy U, I collect in a hystogram the 
values, at regular time intervals, of the three components of particle- 1 velocity 
(see Fig. 1 left). Indeed, this hystogram has, in the long run, the finite- N 
MB form. This is indirect evidence that the simulation trajectory samples 
uniformly, at least effectively if not literally, the 3./V-dimensional hypersurface 
of energy U. 

Afterwards, I take N = 1000 and U = 20, and follow the evolution of the 
same hystogram as above, now starting from velocity values extracted at ran- 
dom from e.g. a uniform one-particle distribution of variance U/(3N). The 
long-run distribution of velocity no. 1 compares well with a Gaussian (Fig. 1 
right), that is with the large- iV form of the MB distribution. In fact, also 
the instantaneous velocities of all particles are asymptotically distributed, for 
large N, according to the same Gaussian (see Fig. 2). This indicates that: 1) 
the vast majority of points in the energy hypersurface is made of "typical" 
states, i.e., microstates that look more or less similar as far as low-order dis- 
tributions like fi are concerned; and 2) the microstate at which the evolution 
was started is, indeed, untypical [6]. 

• For a given number n of particles in box 1, the equilibrium probability 
density W n (u) of their total energy u can be calculated exactly for w({v}) oc 
S(v 2 + ... + v 2 N -U): 

"«•> " r,3wSU/ 2 ) ^-'^ ~ »)— ■ M> 

that is, variable u/U is 6eta-distributed with an average of n/N. Of all n- 
velocity microstates, the fraction of those states whose energy lies between 
u and u + Au is W n (u)Au (Aw <C u). In particular, the Boltzmann entropy 
associated with Eq. (13) is, for n, iV — n = 0(N) 3> 1: 

i ttt" / n 3n n 3(iV-ra) N — n 

hiWJu) ~ In -In , (14) 

K J 2 u 2 U-u' K J 
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which, when including also the configurational term (3) or (6), gives back 
the expression of the entropy of the (monoatomic) ideal gas. 

In conclusion, I have introduced a stochastic process of the Ehrenfest type 
which allows one to found microscopically the expression of the thermody- 
namic entropy of an ideal gas, without relying on the hypothesis of equal 
a priori probability of all microstates. Rather, the validity of the latter, at 
least in an effective sense, follows as an outcome from the stochastic dynam- 
ics itself. In thermodynamics, the Second Law requires the maximization 
of the total entropy S under the given constraints (here, the total number 
of particles N and the total energy U of two ideal gases in grand-canonical 
contact) in order to find the equilibrium state of an overall isolated system. 
In the present model, this very same prescription emerges naturally, when 
defining entropy a la Boltzmann, as the condition upon which the partition 
of N and U between the gases be, in the long-time regime, the most probable. 
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FIGURE CAPTIONS 



Fig. 1 : Numerical simulation of Eq. (8). Hystogram of velocity values for 
particle 1 (A, □, and O correspond to the x, y, and z component, 
respectively). Two distinct values of N are compared, i.e., 3 (left) and 
1000 (right), while U/N = 0.02 in both cases. After rejecting a total 
of 10 4 collisions per particle (CPP), as many as Af cq CPP are produced 
(jV eq = 10 7 for iV = 3 and Af eq = 10 6 for N = 1000). The p value 
was 0.5, held fixed during the simulation. Data (in form of frequencies 

of occurrence) are grouped in bins of width 8v = 2^JjJ/N/31 (after 
equilibration, the hystogram is updated every 10 CPP). The full curve 
is the theoretical, finite- N MB distribution per velocity component, 
which, for N = 3, is appreciably different from the infinite- N limit (i.e., 
the Gaussian k/ti exp(— kv 2 ), with k = 3N/(2U) - broken curve in 
the left panel, full curve in the right panel). 

Fig. 2 : Numerical simulation of Eq. (8). Top: Particle velocities at the 
end of the simulation run for iV = 1000 and U — 20 (same symbols 
and notation as in Fig. 1). The distribution of all-particle velocities at 
a given time strongly resembles the same Gaussian as in Fig. 1 (full 
curve). Bottom: Difference between the above hystogram and this 
Gaussian law. 
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Figure 1: 
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Figure 2: 
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